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10. Method for Without conceding that the preamble of claim 10 of the “449 Patent is limiting, the OnePlus 10T 
exchanging (hereinafter, the “OnePlus product”) performs a method for exchanging messages in an integrated 
messages in an circuit comprising a plurality of modules, either literally or under the doctrine of equivalents. 
integrated circuit 

comprising a The OnePlus product includes an integrated circuit. For example, the OnePlus product includes 
plurality of the Snapdragon 8+ Gen 1 Mobile Platform system on chip (hereinafter, the “Snapdragon SoC”). 
modules, 


OnePlus 10T 


Powered by Snapdragon 8+ Gen 1 Mobile Platform 


OnePlus 10T 5G is the speed-leading flagship delivering 


ultimate performance. Driven relentlessly by the fastest 


charging in OnePlus history and the powerful Snapdragon 8+ 
Gen 1 mobile platform, this is a phone built to evolve beyond 
speed. It has Qualcomm FastConnect 6900 for premium Wi- 


Fi connectivity and a Kryo CPU for unbeatable performance. 


https: / /www.qualcomm.com/snapdragon/ device-finder /smartphones/oneplus-10t 


1 The OnePlus product is charted as a representative product made used, sold, offered for sale, and/or imported by OnePlus. The citations to evidence contained herein are 
illustrative and should not be understood to be limiting. The right is expressly reserved to rely upon additional or different evidence, or to rely on additional citations to the evidence 
cited already cited herein. 
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$) Snapdragon 


8+ mobile platform 
Gen 1 


Artificial Intelligence Camera 
Qualcomm* Adreno” GPU Qualcomm Spectra” Image Signal Processor 


Qualcomm" Kryo” CPU : Triple 18-bit ISPs 


- Uptos 
(CV-ISP) 
* Up to 3é 
Shutter Lag 


Gigapixels per Second computer vision ISP 


Qualcomm* Hexagon” Processor 


* Fused Al Accelerator 


MP triple camera @ 30 FPS with Zero 


Hexagon Tensor Accelerator 


Hexagon Vector eXtensions 


- Up to 64+36 MP dual camera @ FPS with Zero 


Hexagon Scalar Accelerator Shutter Lag 
* Support for mix precision( INT8+INTI4) * Up to 108 MP single camera @ 30 FPS with Zero 
+ Support for all precisions (INT8, INTI6, FP16) Shutter Lag 


= aa - Up to 200 Megapixel Photo Capture 
Qualcomm* Sensing Hub : 


Rec 
5G Modem-RF System Up to 10-bit color depth photo and video capture 
8K HDR Video Capture + 64 MP Photo Capture 


color gamut photo and video capture 


Snapdragon* X65 5G Modem-RF System 


standalone 10-bit HEI”: HEIC photo capture, HEVC video capture 


- 5G mmWave and sub-6 GHz 
* (SA) and non-standalone (NSA) modes, FDD, TDD 
* Dynamic Spectrum Sharing 

2x2 MIMO 


* mmWave: 8 carriers 


* Sub-6 GHz: 4x4 MIMO 4K Video Capture ¢ 


120 FPS 


* Qualcomm" 5G PowerSave 2.0 fe 


w-mo video capture at 720p @ 960 FPS 


* Qualcomm* Smart Transmit” 2.0 technology 


Bokeh Engine for Video Capture 
* Qualcomm" Wideband Envelope Tracking . 
A P « e Video super resolution 
* Qualcomm* Al-Enhanced Signal Boost 
- Global SG multi-SIM Multi-framme Noise Reduction (MFNR) 
Locally Motion Compensated Termporal Filtering 
Downlink: Up to 10 Gbps 2 . 


5G NR, LTE including CBRS, 
AA Ix, EV-DO, GSM/EDGE 


Multi-Frame and triple exposure staggered/digital 
overlap HDR dual-sensor support 


Multimode support: 
WCDMA, HSPA, C 


Al-based face detection, auto-focus, and 


The Snapdragon SoC comprises a plurality of modules, for example Qualcomm Adreno GPU; 
Qualcomm Kryo CPU; Qualcomm Hexagon Processor; and Platform Security Foundations, 
Trusted Execution Environment & Services, Secure Processing Unit (SPU): 


SPECIFICATIONS & FEATURES 


CPU 
Kryo CPU 
+ Up to 3.2 GHz) with Arm Cortex-X2 technology 


* 64-bit Architecture 


Visual Subsystem 


Adreno GPU 

* Vulkan* 1.1 API support 

* HDR gaming (10-bit color depth, Rec. 2020 
color gamut) 

* Physically Based Rendering 

* Volumetric Rendering 

+ Adreno Frame Motion Engine 

+ API Support: OpenGL* ES 3.2, OpenCL™ 2.0 FP, 
Vulkan 11 


* Hardwoare-cccelerated H.265 and VP9 decoder 


+ HDR Playback Codec support for HDRIO+, HDRIO, 
HLG and Dolby Vision 


Security 


Ptatform Security Foundations, Trusted Execution 


Environment & Services, Secure Processing Unit (SPU) 
Trust Management Engine 


Qualcomm” wireless edge services (WES) and 


premium security features 


Qualcomm’ 3D Sonic Sensor and Qualcomm’ 3D 


Sonic Max (fingerprint sensor) 


Qualcomm Type-] Hypervisor 
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Wi-Fi & Bluetooth® ia 


Qualcomm’ FastConnect™ 6900 Systerr 


Audio 


Wi-Fi Standards: Wi-Fi 6E, Wi-Fi 6 (8021ax) 


Qualcomm Agqstic” audio codec (WWCD9385) 
Wi-Fi 5 (8021lac), 802.1a/b/a/n 

N alcomm Aastic smart speaker amplifier 
Wi-Fi Spectral Bands: 24 GHz, 5 GHz, 6 GHz P 
Pp d: 3.6 Gbps 


Total Harmonic Distortion + Noise (THD+N), Playback 


* Channel Bandwidth: 20/40/80/160 MHz 108dB 


+ &-stream sounding (for 8x8 MU-MIMO) ae ? 
Qualcomm’ Audio and Voice Communication Suite 
onfiguration: 2x2 (2-stream) 


) (Uplink & Downlink) * 
Display 
OFDMA (Uplink & Downlink) On-Device Display Support 


x2 + 2x2) Dual Band Simultaneous (DBS * 4K @60 Hz 


ced * QHD+ @144H 


Maximum External Display Support 


Integrated Bluetooth up to 4K @ 60 Hz 
y2( 


10-bit color depth, Rec. 2020 color gamut 


+ HDRIO and HDRIO+ 


Bluetooth® 5.3, LE Audio, Dual 


* Bluetooth Features: 


Bluetooth antennas 


Demura and subpixel rendering for OLED Uniformity 


snapdragon.com 


https: //www.qualcomm.com/content/dam 


Charging 


Qualcomm’ Quick Charge” 5 Technoloay 


Location 


trian navigation with 
sidewalk accuracy 


+ Global freeway lane-level vehicle navigation 


Memory 
Support for LP-DDRS memory up to 3200 MHz 


Memory Density: up to 6 GB 


General Specifications 


Full Suite of Snapdragon Elite Gaming” features 


& nm Proc 


USB Version 3.1; USB Ty 


Part Number: SM8& 


comm-martech/dm- 


assets / documents /Snapdragon-8-plus-Gen-1-Product-Brief.pdf 
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The Snapdragon SoC included in the OnePlus product utilizes Arteris network on chip 
interconnect technology, and/or a derivative thereof, (collectively, the “Arteris NoC”) to 
exchange messages: 


Qualcomm 


QuALCOMW\ 


Arteris-developed NoC technology is the 
backbone of Snapdragon application 
processors & LTE modems, Atheros 
wireless connectivity SoCs, and CSR loT 
products. 


LEARN MORE » 


https: / /web.archive.org/web/20210514110614/https: / /www.arteris.com/customers 
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Certain Arteris Technology Assets Acquired 


by Kurt Shuler, on October 31, 2013 


Arteris to continue to license, support and maintain Arteris FlexNoC@ interconnect IP 


SUNNYVALE, California — October 31, 2013 — Arteris Inc., a leading innovator and supplier of silicon-proven 
commercial network-on-chip (NoC) interconnect IP solutions, today announced that Qualcomm Technologies, 
Inc. (“Qualcomm”), a subsidiary of Qualcomm Incorporated, has acquired certain technology assets from Arteris 
and hired personnel formerly employed by Arteris. 


@G Arteris NoC technology has been and will continue to be a key enabler for 
creating larger and more complex chips in a shorter amount of time at a 
lower cost. This acquisition of our technology assets represents a validation 
of the value of Arteris’ Network-on-Chip interconnect IP technology. 


ARTERISia 


K. Charles Jonac, President and CEO, Arteris 


https: //www.arteris.com/ press-releases /Qualcomm-Arteris-asset-acquisition-2013_oct_31; 
https: //www.fiercewireless.com/tech/qualcomm-acquires-arteris-noc-tech-assets-team 


The Arteris NoC exchanges messages in the Snapdragon SoC included in the OnePlus product. 


For example, in the Arteris NoC, “[m]ost transactions require the following two-step transfers,” 
including “[a] master send[ing] request packets” and “the slave return[ing] response packets”: 
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11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 


on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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Initiator 


NIU 


=z Rx - "TX 
rs mn Request 
é we packets 
< a af 
oo, 
S ° 
g| 2 
e|= * \ 
By) _ 
fav] 
| Response a 
=| packets . 
ay —> 
Request network 
_—_> 
Response network 
FIGURE 11.1 


NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 312-313; see id at 308 
(explaining that Chapter 11 of this book describes the function of the Arteris NoC: “In this chapter 
we will present an MPSoC platform [...] using Arteris NoC as communication infrastructure.”). 


the messages 
between the 
modules being 


Without conceding that the preamble of claim 10 of the “449 Patent is limiting, the Arteris NoC 
exchanges messages between modules in the Snapdragon SoC included in the OnePlus product 
over connections via a network, wherein said connections comprises a set of communication 
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exchanged over 
connections via a 
network, wherein 
said connections 
comprises a set of 
communication 
channels each 
having a set of 
connection 
properties, any 
communication 
channel being 
independently 
configurable, 


channels each having a set of connection properties any communication channel being 
independently configurable, either literally or under the doctrine of equivalents. 


A large SoC, such as the Snapdragon SoC included in the OnePlus product may include multiple 
classes of Arteris NoC interconnect network: 


Logical Interconnect Topology Development 


FLEXNOC & NCORE INTERCONNECT IPS DEFINE ARCHITECTURES Main NoC 


Ncore Cache Coherent NoC 
fone = a6 


GPU || DSP 
cpu || CPU | g 
big litte |) mu || MMU 


] — 
ace || ace || ace || ace || ACE | aA 
CAIU || CAIU || CAIU |] CAIU |) Cary | 
] C_ cy | 
Coherent | | ~ aaaé PPAR PP 
Subsystént SBM 
j P ii Py) Pel Lite 
E A Main Interconnect fogs ‘s 
PRY  CacheCoherent Us 
Interconnect P) (P) |P) |P] (P| (P| (P| {P| |P) (P| {P} |P) P| |p) PI 
=f | lA \al ety 
pe BOAR T EERO EAA | @ «—«—-——penya aunty ||| | am 
4 P| oss CSR == 
Noc 
emu) [MU Fi = a g 
Do DI BI ses | 
o f 2 ‘ 9 
ad 
Q 
Memory NoC 


| SRAM DRAM DRAM DRAM DRAM 


e ArChipi6 Example: Large SoCs have multiple classes of interconnect 
— Non-coherent, Coherent, Control/Status, Observability, etc. 
e Neore & FlexNoC interconnects are managed separately from IP blocks, increasing design flexibility 


ISPD 2018, 28 March 2018 Copyright © 2018 ArterisIP =| 9 


ARTERIS@ 


See Physical Interconnect Aware Network Optimizer, http://www.ispd.cc/slides/2018/s7_2.pdf, 


at slide 9. 
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The Snapdragon SoC included in the OnePlus product utilizes the Arteris NoC to exchange 
messages over connections via a network, wherein said connections comprises a set of 
communication channels that are independently configurable. 


For example, in the the Arteris NoC, “[a]n NTTP transaction is typically made of request packets, 
traveling through the request network between the master and the slave NIUs, and response 
packets that are exchanged between a slave NIU and a master NIU through the response 
network.... Transactions are handed off to the transport layer, which is responsible for delivering 
packets between endpoints of the NoC (using links, routers, muxes, rated adapters, FIFOs, etc.). 
Between NoC components, packets are physically transported as cells across various interfaces, a 
cell being a basic data unit being transported. This is illustrated in Figure 11.1, with one master 
and one slave node, and one router in the request and response path.” 


10 
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Initiator 
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FIGURE 11.1 


NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 


theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 312-313. 


Connections within the Arteris NoC network may be defined by a connectivity table: 
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Connectivity Map — Interconnect Connections — Layout 
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» Connectivity table defines interconnect connections within the floorplan DC-Topographical 


» Routes must pass through available channels in the floorplan 
* Connectivity passes from initiator NIU to switch, to link, to RC buffers and finally to target NIU 


Copyright © 2018 Arteris IP | 12 


AR TERISM@@ ISPD 2018, 28 March 2018 
See Physical Interconnect Aware Network Optimizer, http://www.ispd.cc/slides/2018/s7_2.pdf 
at slide 12. 


In the Arteris NoC, “[t]he delivery of packets within the NoC is the responsibility of the physical 
layer [where the] link size, or width (i.e., number of wires), is set by the designer at design 
time[and] [o]ne link (represented in Figure 11.1) defines the following signals... Pres. — Indicates 
the current priority of the packet used to define preferred traffic class (or Quality of Service). The 
width is fixed during the design time, allowing multiple pressure levels within the same NoC 
instance (bits 3-5 in Figure 11.2) [and] RxRdy — flow control”: 


12 
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11.3.1.3 Physical Layer 


The delivery of packets within the NoC is the responsibility of the physical 
layer. Packets, which have been split by the transport layer into cells, are 
delivered as words that are sent along links. Within a single clock cycle, the 
physical layer may carry words comprising a fraction of a cell, a single cell, 
or multiple cells. The link size, or width (i.e., number of wires), is set by the 
designer at design time and determines the number of cells of one word. 
NTTP defines five possible link-widths: quarter (QRT), half (HLF), single 
(SGL), double (DBL), and quad (QUAD). A single-width (SGL) link transmits 
one cell per clock cycle, a double-width link transmits two cells per clock cycle, 
and so on. Words travel within point-to-point links, which are independent 
from other protocol layers: a word is sent through a transmit port, Tx, over a 
link to a receive port, Rx. The actual number of wires in a link depends on the 


13 


4856-3064-3265.3 


Case 2:22-cv-00481-JRG Document 1-39 Filed 12/19/22 Page 14 of 53 PagelD #: 1916 


U.S. Patent No. 7,373,449 (Radulescu and Goossens) 


“Apparatus and method for communicating in an integrated circuit” 


4856-3064-3265.3 


maximum cell-width (header, necker, and data cell) and the link-width. One 
link (represented in Figure 11.1) defines the following signals: 


Data—Data word of the width specified at design-time. 


Frm—When asserted high, indicates that a packet is being transmit- 
ted. 


Head—When asserted high, indicates the current word contains a 
packet header. When the link-width is smaller than single (SGL), the 
header transmission is split into several word transfers. However, 
the Head signal is asserted during the first transfer only. 


TailOfs—Packet tail: when asserted high, indicates that the current 
word contains the last packet cell. When the link-width is smaller 
than single (SGL), the last cell transmission is split into several word 
transfers. However, the Tail signal is asserted during the first transfer 
only. 

Pres.—Indicates the current priority of the packet used to define 
preferred traffic class (or Quality of Service). The width is fixed 
during the design time, allowing multiple pressure levels within 
the same NoC instance (bits 3-5 in Figure 11.2). 


V1ld—Data valid: when asserted high, indicates that a word is being 
transmitted. 

RxRdy—Flow control: when asserted high, the receiver is ready to 
accept word. When de-asserted, the receiver is busy. 


This signal set, which constitutes the Media Independent NoC Interface 
(MINI), is the foundation for NTTP communications. 
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See Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 313-314. 


The Snapdragon SoC included in the OnePlus product utilizes the Arteris NoC’s connections that 
comprise a set of communication channels each having a set of connection properties, any 
communication channel being independently configurable. 


For example, as noted above, in the Arteris NoC, “[o]ne link (represented in Figure 11.1) defines 
the following signals... Pres. — Indicates the current priority of the packet used to define preferred 
traffic class (or Quality of Service) [and] RxRdy —flow control.” 


In the Arteris NoC implements Quality of Service (QoS) to “provides a regulation mechanism 
allowing specification of guarantees on some of the parameters related to the traffic”: 


Quality of Service (QoS). The QoS is a very important feature in the inter- 
connect infrastructures because it provides a regulation mechanism allowing 
specification of guarantees on some of the parameters related to the traf- 
fic. Usually the end users are looking for guarantees on bandwidth and/or 
end-to-end communication latency. Different mechanisms and strategies have 
been proposed in the literature. For instance, in Aithereal NoC [11,24] pro- 
posed by NXP, a TDMA approach allows the specification of two traffic cat- 
egories [25]: BE and GT. 

In the Arteris NoC, the QoS is achieved by exploiting the signal pressure em- 
bedded into the NTTP packet definition (Figures 11.1 and 11.2). The pressure 
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signal can be generated by the IP itself and is typically linked to a certain level 
of urgency with which the transaction will have to be completed. For exam- 
ple, we can imagine associating the generation of the pressure signal when a 
certain threshold has been reached in the FIFO of the corresponding IP. This 
pressure information will be embedded in the NTTP packet at the NIU level: 
packets that have pressure bits equal to zero will be considered without QoS; 
packets with a nonzero value of the pressure bit will indicate preferred traffic 
class.* Such a QoS mechanism offers immediate service to the most urgent 
inputs and variables, and fair service whenever there are multiple contend- 
ing inputs of equal urgency (BE). Within switches, arbitration decisions favor 
preferred packets and allocate remaining bandwidth (after preferred packets 
are served) fairly to contending packets. When there are contending preferred 
packets at the same pressure level, arbitration decisions among them are also 
fair. 
The Arteris NoC supports the following four different traffic classes: 


16 
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e Real time and low latency (RTLL)—TIraffic flows that require the 
lowest possible latency. Sometimes it is acceptable to have brief 
intervals of longer latency as long as the average latency is low. 
Care must be taken to avoid starving other traffic flows as a side 
effect of pursuing low latency. 


¢ Guaranteed throughput (GT)—TIraffic flows that must maintain 
their throughput over a relatively long time interval. The actual 
bandwidth needed can be highly variable even over long intervals. 
Dynamic pressure is employed for this traffic class. 


e Guaranteed bandwidth (GBW)—Iraffic flows that require a guar- 
anteed amount of bandwidth over a relatively long time interval. 
Over short periods, the network may lag or lead in providing this 
bandwidth. Bandwidth meters may be inserted onto links in the 
NoC to regulate these flows, using either of the two methods. If the 
flow is assigned high pressure, the meter asserts backpressure (flow 
control) to prevent the flow from exceeding a maximum bandwidth. 
Alternatively, the meter can modulate the flows pressure (priority) 
dynamically as needed to maintain an average bandwidth. 


e Best effort (BE)—TIraffic flows that do not require guaranteed 
latency or throughput but have an expectation of fairness. 


17 
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* Note that in the NTTP packet, the pressure field allows more then one bit, resulting in multiple 
levels of preferred traffic. 


Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 315-316. 


As a further illustration, the Arteris NoC “addresses ... varied QoS needs in many ways,” 
including “Dynamic Packet Priorities” and “Dynamic Pressure Propagation”: 


Arbitration: Dynamic Packet Priorities & Dynamic 
Pressure Propagation 


Arteris Network on Chip technology addresses these varied QoS needs in many 
ways: First, the interconnect assigns priorities to transactions to ensure they arrive 
at the target in the proper order to meet system requirements. Priority levels can be 
attached to individual packets or to all transactions pending on a socket. The 
interconnect can also assign Dynamic Packet Priorities at runtime. 


Second, the interconnect can sense when high priority packets may be blocked or 
slowed due to downstream traffic congestion and can then clear a path for these 
high priority packets. This technology, called Dynamic Pressure Propagation, is 
analogous to a fire truck racing down city streets: All traffic pulls to the side of the 
road to let the fire truck through. 


https: //www.arteris.com/end-to-end-quality-of-service-qos 
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As a further illustration, “QoS information may be generated from within the [Arteris] NoC 
interconnect using Arteris’ QoS Generator”: 


Bandwidth Limiters and Rate Regulators 


Many times architects will want to implement QoS within their SoC but the QoS 
prioritization data is not available from the individual IP blocks. In this case, QoS 
information may be generated from within the NoC interconnect using Arteris’ QoS 
Generator. The QoS Generator can instantiate sophisticated, and software 
programmable, means to regulate interconnect QoS, including: 


> Bandwidth Limiters - Bandwidth limiters cause a socket to stop accepting 
requests when a run-time programmable throughput threshold has been 
exceeded. 

> Rate Regulators - Rate regulators cause a socket's transactions to be demoted 
when a bandwidth threshold is reached. This can be considered a smoother 
version of the bandwidth limiter because transactions are only demoted 


instead of stalled. 


https: //www.arteris.com/end-to-end-quality-of-service-qos 


As a further illustration, the Arteris NoC uses “a mechanism called rated adaptation, which stalls 
packets just enough to remove wait states from the packets, preserving a low latency.” For other 
traffic, the “[b]est effort traffic can be left untouched|[,]” “[l]atency sensitive traffic may have its 
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urgency modulated as a function of the transaction[,]” “[s]oft real-time traffic may have its hurry 
level modulated as a function of the bandwidth it receives|,|” and “[o]n the real-time modem data 
port, the hurry is fixed at a critical level”: 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


See Application driven network-on-chip architecture exploration & refinement for a complex SoC, 


https:/ /www.arteris.com/hs-fs/hub/48858 / file-14363521- 
pdf/docs/springerappdrivennocarchitecture8.5x11.pdf, at pg.16. 


For the other traffic, “the configuration can be done in architecture”: 
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e Best effort traffic can be left untouched. 

e Latency sensitive traffic may have its urgency modulated as a function of the transaction: 
Normal for writes and important for reads. 

e Soft real-time traffic may have its hurry level modulated as a function of the bandwidth 
it receives: Critical until a specified bandwidth is obtained on a sliding 4 microsecond 
window, and normal thereafter. These settings are set through configuration registers and 
may be modified while the interconnect is running. The mechanism is called a bandwidth 
regulator. 

e On the real-time modem data port, the hurry is fixed at a critical level. 


Id. at 18. 


As a further illustration, connections within the Arteris NoC may be classified by traffic class and 
traffic classes may be mapped onto the Arteris interconnect topology: 
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Memory NoC: 
Interconnect Topology — Traffic Classes 


Classify your IP connections per class of 


traffic: 

| Best Effort (BE) Image system | 

Low Latency (LL) SRAM | q 

| High Bandwidth (HB) Main/Coherency | Modifications 

Defer | cr 
jcwo—id| CCB BE BE) BE 
Pose | BE BE BE BE 
[RomcsiNeGient—|LL HB HB HB HB 7 
Romvsawocvo LL HB HB HB HB 7 
jispvo—“‘CCOW# BE BED BE BE 
ARTERIS@ ISPD 2018, 28 March 2018 Copyright © 2018 Arteris IP | 13 
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Memory NoC: 
Traffic classes are mapped onto logical interconnect topology 


ARTERISiMa ISPD 2018, 28 March 2018 Copyright © 2018 Arteris IP | 16 
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at slides 11, 13, 16. 


See Physical Interconnect Aware Network Optimizer, http: 


ISPD 2018, 28 March 2018 


¢ Cache Coherent (CC) 
within Compute Cluster 


° Low Latency (LL) to 
SRAM 


e High Bandwidth (HB) 
to DRAM & Cache Fill 


Best Effort (BE) for 
Peripherals & DMA 


e QoS for Video 


& 


e Multiple functional 
NoCs interacting 


e Physically Constrained 


Copyright © 2018 Artes IP | 11 


www.ispd.cc/slides/2018/s7_2.pd 


As a further illustration, in the Arteris NoC, “QoS is supported in the switch using pressure 
information generated by the IP itself and embedded in NTTP packets” and “[s]ome features [of 
the switch] can be software-controlled at runtime through the service network”: 
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11.3.3.1 Switching 


The switching is done by accepting NTTP packets carried by input ports and 
forwarding each packet transparently to a specific output port. The switch is 
characterized with a fully synchronous operation and can be implemented 
as a full crossbar (up to one data word transfer per port and per cycle), 
although there is an automatic removal of hardware corresponding to unused 
input/output port connections (port depletion). The switch uses wormhole 
routing, for reduced latency, and can provide full throughput arbitration; that 
is, up to one routing decision per input port and per cycle. An arbitrary num- 
ber of switches can be connected in cascade, supporting any loopless network 
topology. The QoS is supported in the switch using the pressure information 
generated by the IP itself and embedded in NTTP packets. 

A switch can be configured to meet specific application requirements by 
setting the MINI-ports (Rx or Tx ports, as defined by the MINI interface 
introduced earlier) attributes, routing tables, arbitration mode, and pipelining 
strategy. Some of the features can be software-controlled at runtime through 
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the service network. There is one routing table per Rx port and one arbiter 
per Tx port. Packet switching consists of the following four stages: 


1. Choosing the route—Using relevant information extracted from 
the packet, the routing table selects a target output port. 


2. Arbitrating—Because more than a single input port can request a 
given output port at a given time, an arbiter selects one request- 
ing input port per output port. The arbiter maintains input/output 
connection until the packet completes its transit in the switch. 


3. Switching—Once routing and arbitration decisions have been made, 
the switch transports each word of the packet from its input port to 
its output port. The switch implementation employs a full crossbar, 
ensuring that the switch does not contribute to congestion. 


4. Arbiter release—Once the last word of a packet has been pipelined 


into the crossbar, the arbiter releases the output, making it available 
for other packets that may be waiting at other input ports. 


The simplified block diagram of the switch architecture is shown in 
Figure 11.6. 
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Router Architecture 


Input Crossbar Output 
Controller i i Controller 


Target Output Output Crossbar 
Address Number Request (Flow control) 


Route 
Table 


Configuration Supervision Registers | Buftering 
Pipeline stage 
it Service Bus [ r y 
FIGURE 11.6 


Packet transportation unit: Router architecture. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 319-320. 
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As a further illustration, the “Pres.” signal in the NTTP packet “[i]ndicates the current priority of 
the packet used to define preferred traffic class (or Quality of Service). The width is fixed during 
the design time, allowing multiple pressure levels within the same NoC instance (bits 3-5 in 
Figure 11.2).” 


35 29 28 25 24 15 14 543 0 

Header Master Address Slave Address Pr] Opcode _] 
Necker [___Tag emf ——~CSSrweroffset——SSS*~*~CSCS Stats] StOpO 
Data [BE[ DataByte [BE] DataByte [BE] DataByte [BE] DataByte 
Data [BEL DataByte BE. Data Byte ]BE] DataByte [BE] DataBye 
32 3130 27 26 20 19 14 13 ie as | 0 

Header Rev [| Len Master Address [Pr] Opcode 
Data ce] COCCCCOCCC at CCC 
Data ee 8s 


FIGURE 11.2 
NTTP packet structure. 


See id. at 313, 314. 
As a further illustration, in the Arteris NoC, “the routing tables actually used in the switch are 


for each switch input. Routing tables can optionally be programmed via the service network 
interface; in this case, their configuration registers appear in the switch register address map.” 


See id. at 322. 
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wherein said Without conceding that the preamble of claim 10 of the ‘449 Patent is limiting, the Arteris NoC in 
connection the Snapdragon SoC included in the OnePlus product has connections through the network that 
through the support transactions comprising at least one of outgoing messages from the first module to the 
network supports | second module and return messages from the second module to the first module, either literally 
transactions or under the doctrine of equivalents. 


comprising at least 
one of outgoing For example, in the Arteris NoC used by the Snapdragon SoC included in the OnePlus product, 
messages from the | “[ml]ost transactions require the following two-step transfers,” including “[a] master send[ing] 
first module to the | request packets” and “the slave return[ing] response packets”: 

second module 


viene 11.3.1.1 Transaction Layer 

messages from the 

second module to The transaction layer is compatible with bus-based transaction protocols used 
the first module for on-chip communications. It is implemented in NIUs, which are at the 


boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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FIGURE 11.1 
NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 312-313. 


and further In the Arteris NoC in the Snapdragon SoC included in the OnePlus product, the first module 
comprising the issues a request for a connection with the second module to a communication manager, wherein 
steps of: the request comprises desired connection properties associated with the sets of communication 


channels, either literally or under the doctrine of equivalents. 
the first module 
issuing a request 
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for a connection 
with the second The first module of the Snapdragon SoC included in the OnePlus product utilizes the Arteris NoC 


module to a to issue a request for a connection with the second module to a communication manager. 
communication 

manager, wherein | For example, in the Arteris NoC, “[mlJost transactions require the following two-step transfers,” 
the request including “[a] master send[ing] request packets” and “the slave return[ing] response packets”: 
comprises desired 

Sean 11.3.1.1 Transaction Layer 

properties 

associated with The transaction layer is compatible with bus-based transaction protocols used 
the sets of for on-chip communications. It is implemented in NIUs, which are at the 
a boundary of the NoC, and translates between third-party and NTTP proto- 
channels; 


cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 312-313. 


The request issued by first module of the Snapdragon SoC included in the OnePlus product 
comprises desired connection properties associated with the sets of communication channels. 


For example, in the Arteris NoC, “[t]he delivery of packets within the NoC is the responsibility of 
the physical layer [where the] link size, or width (i.e., number of wires), is set by the designer at 
design time[and] [o]ne link (represented in Figure 11.1) defines the following signals... Pres. — 
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Indicates the current priority of the packet used to define preferred traffic class (or Quality of 
Service). The width is fixed during the design time, allowing multiple pressure levels within the 
same NoC instance (bits 3-5 in Figure 11.2) [and] RxRdy — flow control”: 


11.3.1.3 Physical Layer 


The delivery of packets within the NoC is the responsibility of the physical 
layer. Packets, which have been split by the transport layer into cells, are 
delivered as words that are sent along links. Within a single clock cycle, the 
physical layer may carry words comprising a fraction of a cell, a single cell, 
or multiple cells. The link size, or width (i.e., number of wires), is set by the 
designer at design time and determines the number of cells of one word. 
NTTP defines five possible link-widths: quarter (QRT), half (HLF), single 
(SGL), double (DBL), and quad (QUAD). A single-width (SGL) link transmits 
one cell per clock cycle, a double-width link transmits two cells per clock cycle, 
and so on. Words travel within point-to-point links, which are independent 
from other protocol layers: a word is sent through a transmit port, Tx, over a 
link to a receive port, Rx. The actual number of wires in a link depends on the 
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maximum cell-width (header, necker, and data cell) and the link-width. One 
link (represented in Figure 11.1) defines the following signals: 


Data—Data word of the width specified at design-time. 


Frm—When asserted high, indicates that a packet is being transmit- 
ted. 


Head—When asserted high, indicates the current word contains a 
packet header. When the link-width is smaller than single (SGL), the 
header transmission is split into several word transfers. However, 
the Head signal is asserted during the first transfer only. 


TailOfs—Packet tail: when asserted high, indicates that the current 
word contains the last packet cell. When the link-width is smaller 
than single (SGL), the last cell transmission is split into several word 
transfers. However, the Tail signal is asserted during the first transfer 
only. 

Pres.—Indicates the current priority of the packet used to define 
preferred traffic class (or Quality of Service). The width is fixed 
during the design time, allowing multiple pressure levels within 
the same NoC instance (bits 3-5 in Figure 11.2). 


V1ld—Data valid: when asserted high, indicates that a word is being 
transmitted. 

RxRdy—Flow control: when asserted high, the receiver is ready to 
accept word. When de-asserted, the receiver is busy. 


This signal set, which constitutes the Media Independent NoC Interface 
(MINI), is the foundation for NTTP communications. 
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See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26qivv11f0, at 313-314. 


As a further example, in the Arteris NoC, “QoS is achieved by exploiting the signal pressure 
embedded into the NTTP packet definition” where the “pressure signal can be generated by the IP 
itself and is typically linked to a certain level of urgency with which the transaction will have to 
be completed” and the “pressure information will be embedded in the NTTP packet at the NIU 
level”: 


Quality of Service (QoS). The QoS is a very important feature in the inter- 
connect infrastructures because it provides a regulation mechanism allowing 
specification of guarantees on some of the parameters related to the traf- 
fic. Usually the end users are looking for guarantees on bandwidth and/or 
end-to-end communication latency. Different mechanisms and strategies have 
been proposed in the literature. For instance, in A2thereal NoC [11,24] pro- 
posed by NXP, a TDMA approach allows the specification of two traffic cat- 
egories [25]: BE and GT. 

In the Arteris NoC, the QoS is achieved by exploiting the signal pressure em- 
bedded into the NTTP packet definition (Figures 11.1 and 11.2). The pressure 
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signal can be generated by the IP itself and is typically linked to a certain level 
of urgency with which the transaction will have to be completed. For exam- 
ple, we can imagine associating the generation of the pressure signal when a 
certain threshold has been reached in the FIFO of the corresponding IP. This 
pressure information will be embedded in the NTTP packet at the NIU level: 
packets that have pressure bits equal to zero will be considered without QoS; 
packets with a nonzero value of the pressure bit will indicate preferred traffic 
class.* Such a QoS mechanism offers immediate service to the most urgent 
inputs and variables, and fair service whenever there are multiple contend- 
ing inputs of equal urgency (BE). Within switches, arbitration decisions favor 
preferred packets and allocate remaining bandwidth (after preferred packets 
are served) fairly to contending packets. When there are contending preferred 
packets at the same pressure level, arbitration decisions among them are also 
fair. 
The Arteris NoC supports the following four different traffic classes: 
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e Real time and low latency (RTLL)—TIraffic flows that require the 
lowest possible latency. Sometimes it is acceptable to have brief 
intervals of longer latency as long as the average latency is low. 
Care must be taken to avoid starving other traffic flows as a side 
effect of pursuing low latency. 


¢ Guaranteed throughput (GT)—TIraffic flows that must maintain 
their throughput over a relatively long time interval. The actual 
bandwidth needed can be highly variable even over long intervals. 
Dynamic pressure is employed for this traffic class. 


e Guaranteed bandwidth (GBW)—Iraffic flows that require a guar- 
anteed amount of bandwidth over a relatively long time interval. 
Over short periods, the network may lag or lead in providing this 
bandwidth. Bandwidth meters may be inserted onto links in the 
NoC to regulate these flows, using either of the two methods. If the 
flow is assigned high pressure, the meter asserts backpressure (flow 
control) to prevent the flow from exceeding a maximum bandwidth. 
Alternatively, the meter can modulate the flows pressure (priority) 
dynamically as needed to maintain an average bandwidth. 


e Best effort (BE)—TIraffic flows that do not require guaranteed 
latency or throughput but have an expectation of fairness. 
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* Note that in the NTTP packet, the pressure field allows more then one bit, resulting in multiple 
levels of preferred traffic. 


35 29 28 25 24 15 14 543 0 
Header Master Address Slave Address Ps] Opcode__] 
Necker 
Data (BEL __DataByte_ [BE] DataByte [BE] _DataByte [BE] DataByte __—| 
Data 
32 3130 27 26 20 19 14 13 543 0 

Header Master Address [Ps] ____ Opcode 
Data a 
Data lat OOOOOCSCSCS—S 


FIGURE 11.2 
NTTP packet structure. 


Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 313, 315-316. 


As a further example, in the Arteris NoC, “QoS is supported in the switch using pressure 
information generated by the IP itself and embedded in NTTP packets” and the router 
architecture includes blocks such as “Input Controller,” “Flow Control,” “Crossbar (Flow 
control)” “Route Table” and “Arbiter”: 
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11.3.3.1 Switching 


The switching is done by accepting NTTP packets carried by input ports and 
forwarding each packet transparently to a specific output port. The switch is 
characterized with a fully synchronous operation and can be implemented 
as a full crossbar (up to one data word transfer per port and per cycle), 
although there is an automatic removal of hardware corresponding to unused 
input/output port connections (port depletion). The switch uses wormhole 
routing, for reduced latency, and can provide full throughput arbitration; that 
is, up to one routing decision per input port and per cycle. An arbitrary num- 
ber of switches can be connected in cascade, supporting any loopless network 
topology. The QoS is supported in the switch using the pressure information 
generated by the IP itself and embedded in NTTP packets. 

A switch can be configured to meet specific application requirements by 
setting the MINI-ports (Rx or Tx ports, as defined by the MINI interface 
introduced earlier) attributes, routing tables, arbitration mode, and pipelining 
strategy. Some of the features can be software-controlled at runtime through 
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the service network. There is one routing table per Rx port and one arbiter 
per Tx port. Packet switching consists of the following four stages: 


1. Choosing the route—Using relevant information extracted from 
the packet, the routing table selects a target output port. 


2. Arbitrating—Because more than a single input port can request a 
given output port at a given time, an arbiter selects one request- 
ing input port per output port. The arbiter maintains input/output 
connection until the packet completes its transit in the switch. 


3. Switching—Once routing and arbitration decisions have been made, 
the switch transports each word of the packet from its input port to 
its output port. The switch implementation employs a full crossbar, 
ensuring that the switch does not contribute to congestion. 


4. Arbiter release—Once the last word of a packet has been pipelined 


into the crossbar, the arbiter releases the output, making it available 
for other packets that may be waiting at other input ports. 


The simplified block diagram of the switch architecture is shown in 
Figure 11.6. 
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Router Architecture 
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FIGURE 11.6 


Packet transportation unit: Router architecture. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 319-320. 
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the 
communication 
manager 
forwarding the 
request to a 
resource manager; 
the resource 
manager 
determining 
whether a target 
connection with 
the desired 
connection 
properties is 
available; 


In the Arteris NoC in the Snapdragon SoC included in the OnePlus product, the communication 
manager forwards the request to a resource manager and the resource manager determines 
whether a target connection with the desired connection properties is available, either literally or 
under the doctrine of equivalents. 


For example, in the Arteris NoC used by Snapdragon SoC included in the OnePlus product, “QoS 
is supported in the switch” which “choos[es] the route” using a “routing table”; “arbitrat[es]”; and 
“switch[es]” and the router architecture includes blocks such as “Input Controller,” “Flow 


Control,” “Crossbar (Flow control)” “Route Table” and “Arbiter”: 


4856-3064-3265.3 


44 


Case 2:22-cv-00481-JRG Document 1-39 Filed 12/19/22 Page 45 of 53 PagelD #: 1947 


U.S. Patent No. 7,373,449 (Radulescu and Goossens) 
“Apparatus and method for communicating in an integrated circuit” 


‘449 Patent Claim OnePlus Product Including Snapdragon System on Chip! 
11.3.3.1 Switching 


The switching is done by accepting NTTP packets carried by input ports and 
forwarding each packet transparently to a specific output port. The switch is 
characterized with a fully synchronous operation and can be implemented 
as a full crossbar (up to one data word transfer per port and per cycle), 
although there is an automatic removal of hardware corresponding to unused 
input/output port connections (port depletion). The switch uses wormhole 
routing, for reduced latency, and can provide full throughput arbitration; that 
is, up to one routing decision per input port and per cycle. An arbitrary num- 
ber of switches can be connected in cascade, supporting any loopless network 
topology. The QoS is supported in the switch using the pressure information 
generated by the IP itself and embedded in NTTP packets. 

A switch can be configured to meet specific application requirements by 
setting the MINI-ports (Rx or Tx ports, as defined by the MINI interface 
introduced earlier) attributes, routing tables, arbitration mode, and pipelining 
strategy. Some of the features can be software-controlled at runtime through 
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the service network. There is one routing table per Rx port and one arbiter 
per Tx port. Packet switching consists of the following four stages: 


1. Choosing the route—Using relevant information extracted from 
the packet, the routing table selects a target output port. 


2. Arbitrating—Because more than a single input port can request a 
given output port at a given time, an arbiter selects one request- 
ing input port per output port. The arbiter maintains input/output 
connection until the packet completes its transit in the switch. 


3. Switching—Once routing and arbitration decisions have been made, 
the switch transports each word of the packet from its input port to 
its output port. The switch implementation employs a full crossbar, 
ensuring that the switch does not contribute to congestion. 


4. Arbiter release—Once the last word of a packet has been pipelined 


into the crossbar, the arbiter releases the output, making it available 
for other packets that may be waiting at other input ports. 


The simplified block diagram of the switch architecture is shown in 
Figure 11.6. 
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Router Architecture 


Input Crossbar Output 
Controller i i Controller 


Target Output Output Crossbar 
Address Number Request (Flow control) 


Route 
Table 


Configuration Supervision Registers | Buftering 
Pipeline stage 
it Service Bus [ r y 
FIGURE 11.6 


Packet transportation unit: Router architecture. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 319-320. 
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As a further illustration, in the Arteris NoC, “the pressure information used to define the 
preferred traffic class (QoS) of the requesting inputs... [t]he pressure information is given top 
priority by the switch arbiter” and “the input controller extracts pertinent data from packet 
headers, forwards it to the routing table, fetches back the target output number, and then sends a 
request to the arbiter. After arbitration is granted, the input controller transmits the rest of the 
packet to the crossbar. The request to the arbiter is sustained as long as the last word of the packet 
has not been transferred. Upon transferring the last cell of the packet, the arbiter is allowed to 
select a new input.” 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26qivv11f0, at 321, 322. 


the resource In the Arteris NoC in the Snapdragon SoC included in the OnePlus product, the resource manager 
manager responds with the availability of the target connection to the communication manager, either 
responding with literally or under the doctrine of equivalents. 

the availability of 

the target For example, in the Arteris NoC used by the Snapdragon SoC included in the OnePlus product, 
connection to the | “the pressure information used to define the preferred traffic class (QoS) of the requesting 
communication inputs... [t]he pressure information is given top priority by the switch arbiter” and “the input 
manager; and controller extracts pertinent data from packet headers, forwards it to the routing table, fetches 


back the target output number, and then sends a request to the arbiter. After arbitration is 
granted, the input controller transmits the rest of the packet to the crossbar. The request to the 
arbiter is sustained as long as the last word of the packet has not been transferred. Upon 
transferring the last cell of the packet, the arbiter is allowed to select a new input.” 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26qivv11f0, at 321, 322. 
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As a further illustration, in the Arteris NoC, “[t]he arbiter ensures that the connection matrix (a 
row per input and a column per output) contains at most one connection per column, that is, a 
given output is not fed by two inputs at the same time. The dual guarantee— at most one 
connection per row —is handled by the input controller. Each output has an arbiter that includes 
prefiltering. For maximum flexibility, each port can specify its own arbiter from the list of 
available arbiters (random, round robin, LRU, FIFO, or fixed priority).” 


Id. at 322-323. 


the target 
connection 
between the first 
and second 
module being 
established based 
on the available 
properties of said 
communication 
channels of said 
connection. 


In the Arteris NoC in the Snapdragon SoC included in the OnePlus product, the target connection 
between the first and second module is established based on the available properties of said 
communication channels of said connection, either literally or under the doctrine of equivalents. 


For example, in the Arteris NoC used by the Snapdragon SoC included in the OnePlus product, 
“QoS is supported in the switch” which “choos[es] the route” using a “routing table”; 
“arbitrat[es]”; and “switch[es]”: 
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11.3.3.1 Switching 


The switching is done by accepting NTTP packets carried by input ports and 
forwarding each packet transparently to a specific output port. The switch is 
characterized with a fully synchronous operation and can be implemented 
as a full crossbar (up to one data word transfer per port and per cycle), 
although there is an automatic removal of hardware corresponding to unused 
input/output port connections (port depletion). The switch uses wormhole 
routing, for reduced latency, and can provide full throughput arbitration; that 
is, up to one routing decision per input port and per cycle. An arbitrary num- 
ber of switches can be connected in cascade, supporting any loopless network 
topology. The QoS is supported in the switch using the pressure information 
generated by the IP itself and embedded in NTTP packets. 

A switch can be configured to meet specific application requirements by 
setting the MINI-ports (Rx or Tx ports, as defined by the MINI interface 
introduced earlier) attributes, routing tables, arbitration mode, and pipelining 
strategy. Some of the features can be software-controlled at runtime through 
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the service network. There is one routing table per Rx port and one arbiter 
per Tx port. Packet switching consists of the following four stages: 


1. Choosing the route—Using relevant information extracted from 
the packet, the routing table selects a target output port. 


2. Arbitrating—Because more than a single input port can request a 
given output port at a given time, an arbiter selects one request- 
ing input port per output port. The arbiter maintains input/output 
connection until the packet completes its transit in the switch. 


3. Switching—Once routing and arbitration decisions have been made, 
the switch transports each word of the packet from its input port to 
its output port. The switch implementation employs a full crossbar, 
ensuring that the switch does not contribute to congestion. 


4. Arbiter release—Once the last word of a packet has been pipelined 


into the crossbar, the arbiter releases the output, making it available 
for other packets that may be waiting at other input ports. 


The simplified block diagram of the switch architecture is shown in 
Figure 11.6. 
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Packet transportation unit: Router architecture. 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 319-320. 
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In the Arteris NoC, “the pressure information used to define the preferred traffic class (QoS) of 
the requesting inputs... [t]he pressure information is given top priority by the switch arbiter” and 
“the input controller extracts pertinent data from packet headers, forwards it to the routing table, 
fetches back the target output number, and then sends a request to the arbiter. After arbitration is 
granted, the input controller transmits the rest of the packet to the crossbar. The request to the 
arbiter is sustained as long as the last word of the packet has not been transferred. Upon 
transferring the last cell of the packet, the arbiter is allowed to select a new input.” 


See Networks-On-Chips Theory and Practice, https:/ /vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26qivv11f0, at 321, 322. 


As a further illustration, in the Arteris NoC, “[t]he arbiter ensures that the connection matrix (a 
row per input and a column per output) contains at most one connection per column, that is, a 
given output is not fed by two inputs at the same time. The dual guarantee— at most one 
connection per row —is handled by the input controller. Each output has an arbiter that includes 
prefiltering. For maximum flexibility, each port can specify its own arbiter from the list of 
available arbiters (random, round robin, LRU, FIFO, or fixed priority).” 


Id. at 322-323. 


As a further illustration, in the Arteris NoC, “[t]he crossbar implements datapath connection 
between inputs and outputs. It uses the connection matrix produced by the arbiter to determine 
which connections must be established. It is equivalent to a set of m muxes (one per output port), 
each having n inputs (one per input port).” 


Id. at 323. 
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